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Abstract. From a recent paper, we recall the Hopf monoid structure on the 
supercharacters of the unipotent uppertriangular groups over a finite field. 
We give cancelation free formula for the antipode applied to the bases of class 
functions and power sum functions, giving new cancelation free formulae for 
the standard Hopf algebra of supercharacters and symmetric functions in non- 
commuting variables. We also give partial results for the antipode on the su- 
percharacter basis, and explicitly describe the primitives of this Hopf monoid. 



1. Introduction 

The Hopf algebra of symmetric functions in non-commuting variables (known 
as NCSym, WSym, or 11) has a representation theoretic interpretation via the 
supecharacters of the finite groups of unipotent uppertriangular matrices |lj , where 
the product comes from an inflation functor on representations and the coproduct 
comes from the restriction functor on representations. 

As seen in [3], the Hopf algebra H has can been viewed as a functorial image 
to the Hopf monoid scf([/) of superclass functions on unipotent uppertriangular 
groups over a finite fields of cardinality 2. The interest of such construction is both 
conceptual and computational. In this paper we concentrate on computational 
aspects. We derive cancelation free formula for the antipode in some bases and 
describe explicitly the primitives of the Hopf monoid. From the functorial proper- 
ties, this gives us a new cancelation free formula for the antipode in H and better 
understanding of its structure. 

The notion of a supercharacter theory of a finite group was introduced by 
Diaconis-Isaacs [TU] to generalize an approach used by Andre (eg. [6j) and Yan [15] 
to study the characters of the finite groups of unipotent upper-triangular matrices. 
The basic idea is to coarsen the usual character theory of a group by replacing 
irreducible characters with linear combinations of irreducible characters that are 
constant on a set of clumped conjugacy classes, called superclasses. We focus here 
on the supercharacters of the finite groups of upper-triangular matrices Un (q) over 
a field with q elements. 

Most finite groups have more than one possible supercharacter theory, so there is 
not really a canonical choice. However, Keller [12] shows that for every group there 
is a unique finest supercharacter theory with integer values. Our heuristic is that 
this finest integral supercharacter theory should play a special roles in mathematics. 
For the groups J7„ (q) , while the usual supercharacter theory used in lU [3l [6j [101 HH] 
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is not integer valued, there is a natural coarsening (used in [7]) of this supercharacter 
theory that is integer valued. We do not know whether this is the finest integral 
supercharacter theory, but it seems to be even more (combinatorially) natural than 
the usual one. For example, its supercharacter table has a nice decomposition as 
a lower triangular matrix times an upper triangular matrix [7|, and for each q, the 
corresponding Hopf algebra is always isomorphic to the Hopf algebra of symmetric 
functions in non-commuting variables ([1 required q = 2 for that supercharacter 
theory). This allows us to deform bases as q varies. This paper describes the Hopf 
monoid scf ([/) using this integral supercharacter theory instead of the usual one. 
For this reason some of the statements will be slightly different than in [3] , but the 
proofs are the same. 

For Un{q), each subset K C {1,2, gives a subgroup UK{q) C C/„(g) iso- 
morphic to U\K\ (q) I obtained by taking only the rows and columns of K. It turns out 
that restriction to the subgroup U\k\ (q) depends on the subset K. Our construction 
of the Hopf monoid takes these distinctions into account by simultaneously consid- 
ering all groups Uk{<i) with all possible linear orders on the sets K. The usual 
Hopf algebra is obtained by following the isomorphism Uk{<i) — U^k\{q)- How- 
ever, a postponement of this identification allows us to work with a finer structure. 
While in general a supercharacter theory of a group G is not compatible with a 
supercharacter theory of a subgroup H C_ G, the supercharacter theories of Un{q) 
as n varies behave nicely in the sense that the restriction functor sends functions 
constant on superclasses to functions constant on superclasses of the subgroup. 

Bases of scf ([/) are indexed by a generalization of set partitions that also encode 
the linear order of their underlying set. In analogy with the ring of symmetric 
functions, we consider three distinguished bases for scf (J7): the K-basis corresponds 
to superclass characteristic functions (the monomial symmetric functions), the P- 
basis (called the A-basis in 3' ) corresponds to power-sum symmetric functions (with 
some variations), and the x-basis corresponds to the basis of supercharacters. While 
it might be tempting to think of the x-basis as an analogue of Schur functions, this 
analogy seems to be misleading. 

The main thrust of the paper is to develop antipode formulas for these dis- 
tinguished bases and to describe the primitives of scf(J7). Sections |4] and [5] find 
pleasing formulas for the k and P bases, respectively, and Section [01 finds a for- 
mula for a family of basis elements in the x-basis. This last problem seems to be 
much more involved, and even the basic cases we consider lead to some surprising 
combinatorics on ribbon-shaped tableaux with new identities. In Section [7] we de- 
scribe the primitives of sc{(U). In all sections we show how our formulas implies 
new stronger results for the standard Hopf algebra H. 

2. Preliminaries 

We will use the theory on Hopf monoid on species developed by Aguiar and 
Mahajan in [4]. There are shorter introductions to the subject, such as [5] or [3j 
Section 1] . Most of our notation follows [Sj IH [5] , but for labelled set partitions we 
prefer a notation closer to [T]. 

2.1. Set partitions with linear orders. The Hopf monoid scf ([/) is constructed 
from set partitions with linear orders. 
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Given a set let L[K] be the set of linear orders on K . Let [n] = {1, 2, . . . , n}. 
Given <j) G a set partition X of K with respect to (j) is a set A of pairs i ^ j 

with ijjCzK such that 

(a) i-^ j e A implies i -<0 j, 

(b) if i^l^j^k G A, then i = j ii and only if fc = L 
For (j)<^L[K], let 

^0 f Set partitions A of 1 
[ K with respect to J ' 

Note that the linear order already contains the information of the underlying set 
K, so we will typically suppress K in the notation. Such a set partition A gives a 
set partition of K (in the usual sense) by the rule that i,j G K are in the same 
part if i^ j G A. 

Remark 2.1. Note that since we have defined A as a set of pairs, it is quite possible 
that A G iS"^ n iS"^ for two different linear orders (j) and t (possibly even on different 
sets). We make use of this ambiguity, but will also add the linear order to the 
notation if we need it fixed. For example, we might write {4>, A) instead of A if we 
want to specify that A G 5"^. 

It is convenient to draw the set partition A above the total order (j) by drawing 
an arc between elements «,j when i ^ j G A. For example, the set partition 
{1-- 9, 9 --2, 3 --8, 6 --^4} of [9] with respect to the order 614925378 corresponds 
to the set partition {{1, 2, 9}, {3, 8}, {4, 6}} of [9], and is depicted as 

614925378 

We have two natural statistics on set partitions, the dimension dim(A) and the 
nesting statistic nst^ on a pair. For A G 5"^, let 

dim(A) = #{i <^ j k}, 

and for A, ^ G 5"*, let 

nst^ = #{i ^0 j -<0 fc ^0 Z I z^Z G A, j---fc G //}. 

2.2. Supercharacters of W^. Most of the material in this section is adapted from 
[U [To]. A supercharacter theory of a group G is a pair {1C,X) where IC is set 
partition of G such that the parts are unions of conjugacy classes, and X is a set 
partition of the irreducible characters of G, such that 

• 1^1 = \^\, 

• For each X ^ X, the character J^xex x(l)x is constant on the parts of K.. 

• The identity of G is in its own part of IC and the trivial character of G is 
in its own part of X. 

We refer to the parts of K. as superclasses. For each X G A", fix a choice of cx £ Q>o 
such that 

X''=cx^x(l)x (2.1) 
is still a character. Then the {x^ | X G X} are the supercharacters of (/C, X). 
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Let e„ e L[n] denote the usual order on [n] given by 

1 -<e„ 2 <,„ n. (2.2) 

While many possible supercharacter theories are possible, we will focus on a specific 
supercharacter theory for the finite groups of unipotent upper-triangular matrices 

U'" := Un{q) ^{ue GL„(Fg) \ uu ^ 1,1 < i < n,Ukj ^ 0,1 < j < k < n}, 

where is the finite field with q elements. Let 

Tn{q) = {te GL„(F,) I Uj =0,1^ j} 

be the subgroup of diagonal matrices. Define an action of U^" x If^" x Tn{q) on 
the set of nilpotent uppertriangular matrices W^" — Id by 

{a,b,t){u~ld) = t{a{u - ld)b-^)t-^ , for a,b e U^'\t e 

Two elements u,v € W^" are in the same superclass if u — Id and w — Id are in the 
same orbit in If^^ — Id. Each of these orbits has a unique matrix that has at most 
one 1 in every row and column and zeroes elsewhere, so 

{u e {U"" - Id), with at 
most one 1 in every row 
and column and O's elsewhere 

where the second bijection is obtained by letting the coordinates of the nonzero 
entries give the arcs of the set partition. 

The supercharacters are also indexed by 5*^" , and are easiest to describe via their 
character formula. For A, /i G 5*^" and u — Id with superclass type /i, 

{ (_l)|AnMl^dim(A)-|A|(-^_^p-M if i ^^^^ j k, i^k e X 

' implies i'- j,j^ki^i, (2.3) 
0, otherwise. 

In this supercharacter theory, our choice of constants in (j2.1l) is 

g|C( A)|(^_ ^)|A| 

x^(i) 

For each finite set K and for 4> G L[K] we obtain a group 

U^ = {ue GLt,(F,) \uu = l,ie K,Ukj = 0, if j k}, 

where GL^-(Fq) is the group of invertible |iir| x | matrices whose rows and columns 
are indexed by K in the order prescribed by (f), and whose entries are in Fg. Then 
jjcj, ^ and it has a corresponding supercharacter theory indexed by S'^. We 

will add the underlying order to the label on the supercharacter, so if A G iS"^, then 
the corresponding supercharacter is x*-"^'^-*. 
Let 

scf (iJ"^) = C-spanlx^"^'^^ | A G 5"^} 

be the vector space spanned by the supercharacters of W^. If (Ji, J2, ■ ■ ■ ,Je) \= K 
is a set composition of K, then there is a natural injective homomorphism 

t: C/'^l-'i x ••• x jy-^l'^f — > U'l', 

given by 

otherwise. 



'^^^ A/i\ — ' where C(A) = {i -<e„ j -<e„ fc Z | i — -fc, j^/ G A}. 
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This injective function gives a restriction map 

Res^*,^^ ^^,1,^: scf(f/*) scf ((7^l-^i ) ® • • • scf (C/^^^. ) 

If J C K, then we may view f/'^'-' C If^ by identifying J with the set composition 
of K with aU block sizes 1 except for one block J. 

The following proposition is an adaptation of results proved in [16] to our slightly 
coarser supercharacter theory with the exception of (4) , which follows from a simple 
counting argument applied to the supercharacter formula p.3p . 

Proposition 2.2. Let K — {Ji, J2, ■ ■ ■ , Ji) he a set composition of K , and let 
L[K]. Then 

(1) For A e S"^, 



(2) ForJCK,Xe S't', 



(3) For i -<0 I, J C K , and t = q ~ 1, 



3€J 
'-<0 J -<,;>' 



«/ i, / e J, 

ifi<^J,l^J, 
ifieJ,l^J, 



q^t{{bt + l)A'f'\-"'^^ +t J2 «/*,/^ J, 



i -< ,^ j -<,/>'=-< ^ ' 

w/iere a ~ #{j ^ J \ i -<0 j -<0 a?irf = #{i ^ J \ i -<4, j -<<j, I] ■ 
(4) for A e 5-^, 

■m=l A 

If {Ji, J2, ■ ■ ■ , Ji) H is a set composition and (p G M-^] such that (/i = 
(j)i(j)2 ■ ■ • 4>i with G L[Ji], then there exists a surjective homomorphism 

p-.W^ — ^ [/"^i X ••• X U'l'', 

such that 

poi(w)=it, for u e t/"^! X • • • X ;7'^^ 
We therefore obtain an inflation map 

Inf^^,^...^y^, : scf([/"^i)®---®scf(t/*0 ^ scf (f/*) 

given by 

x-xc/** (Xi • • • X^)(u) = (Xi • • • X^)(p('«)), for u e J7"*. 
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Fortunately, inflation has a nice description on supercharactcrs. 

Proposition 2.3. Let (j) G L[I] and t G L[J] with / nJ = 0. For A G 5"^ and 

Each space scf (t/"^) has a second natural basis spanned by the superclass char- 
acteristic functions 

if u is in the superclass 

indexed by /i, for fi £ S'^ , u £ . 

otherwise, 

This basis also has a nice description with respect to the maps Res and Inf. For 
J CK, L[K] and /z G S^, let 

/A/ = {i-i e M U,J e J}. (2.4) 

Note that if either i or j is not in J then ^ fj.j. 

Proposition 2.4. Lef / and J be sets with / n J = 0. Then 

(1) _For G L[/ U J] and G 5"^, 

(2) for G L[I], T G L[J], e S't' and v e 5^, 



A)- 



3. The Hopf monoid of supercharacters 

Here we adapt the results of [3j to our coarser supercharacter theory with the 
notation introduced above. For a fixed q, the Hopf monoid scf({/) is defined as 
follow. For any finite set K, let 

sc{{U)[K]^ scf 

<f>eL[K] 

For K = I Li J, the Hopf monoid scf(J7) has product mj^j (typically denoted by 
"•") given by 

.:scf(C/*)®scf(C/0 ^ scf(f/^-) 

, .C/-^- . ^ ,s for (/) G L[/] and r G L[J], (3.1) 

and coproduct A/_j given by its restriction to the various subspaces scf([/'^) 

Res'"^[[!lf'(A/ j): scf(C/^) ^ scf (C/^l^ ® scf (C/"^!-') 

X ^ R-es[^^|,^y«|,(x), 

We will use Takeuchi's formula several times in this paper. Given a finite set K 
and a set composition J = (Ji, Ji, - ■ ■ , J^) ^ if we define 

"^J = mK\j^,j^ o ■ • ■ o {mj^^j^ <S)ldj^ (g) • ■ • ® IdjJ. (3.3) 

By convention, mj = Id^f if £ = 1. Similarly we let ^(k) — and in general 

Aj = (Aj,,j, ®Idj3 «)---(8)IdjJ 0...0 A^\j,,j,. (3.4) 
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Then Takeuchi's formula says that for ?/; G scf ([/) [K], 

SW= (-l)VjoAj(V^). (3.5) 

J=(Jl,J2,...Ji)\=K 

Remark 3.1. Under the action of ©„, the coinvariant class of any element )(^^4"^'> g 
scf(t/'^) with |supp(</))| — n can be identified with the element x'"'^"''^ & 
scf ([/'^") where o A is the set of arcs one gets by relabeling the arcs according 
to viewed as a permutation. In picture that correspond to simply replace (j) by 
e„ keeping the arcs the same: 

614925378 123456789 

We have that, /C(scf([/)) is isomorphic to 11, as described in [3]. In 11, any set of 
arcs A is assumed to be in 5'" . 

4. Antipode on the P-bases 

Lauve and Mastnak give a formula for the antipode of the P basis in the (stan- 
dard) graded Hopf algebra 11 [13J. The formula is very nice but may still contain 
some cancelation in its expansion. We give a formula for a generalization of P bases 
at the Hopf monoid level, show that it is multiplicity and cancelation free, and that 
the functorial image to the Hopf algebra H is cancelation free as well. 

4.1. Atomic set partitions. Let cf) G -/^[if]. A set partition A G iS"^ is atomic if 
there is no set composition {A, B) \= K such that 

4> = 4>\a4>\b and A = AaUAb. 

Roughly, speaking this means one cannot obtain an atomic set partition by con- 
catenating two other set partitions. 

We will want a slightly more general notion of atomic that captures how atomic 
a set partition can be with respect to a different order. Given two 0, t G L[K] there 
is a unique factorization (jj — 4>i(j)2 ■ ■ ■ 4>k into rising subsequences with respect to 
the order r, where we start a new subsequence at each descent in 4> with respect to 
r. For example, \i (f) — 614925378 and t = 123456789, then the decomposition into 
rising subsequences is given by = 6 • 149 • 25 • 378. 

For (f),T £ L[K], a set partition A G iS"^ is (p-atomic if the set composition 
( Ji, J2, . . . , Jf) oi K coming from the factorization t = t\j-^ ■ ■ ■ T\jg into maximal 
rising subsequences with respect to satisfies 

(a) A = Aj, UAj, U---UAj,, 

(b) Aj^ is atomic for all 1 < A; < £. 

If A ^ S'^, then A is (f>-incompatible, and if A G 5*, but A is not (/)-atomic, then A is 
(p-decomposable. 

Note that 0-atomic matches our definition for atomic when t — (j). 
For example, 

614925378 

is simultaneously (3, 7, 8, 5, 6, 1, 4, 9, 2)-atomic, (6, 1, 4, 9, 2, 5, 3, 7, 8)-decomposable, 
and eg-incompatible. It is none of the above with respect to (6, 1, 9, 4, 2, 5, 3, 7, 8). 



8 



D. BAKER-JARVIS, N. BERGERON, AND N. THIEM 



4.2. Power-sum friendly posets. We now give a more general lemma concerning 
posets of set partitions with linear order. If < is a partial order on ordered set 
partitions, let <0 denote the restriction of the order to S'^. A partial order < on 
ordered set partitions is power-sum friendly if 

(1) Let (j) e L[/], T e L[J] with / n J 0, and p e L[I U J] with p\i = cj) and 
p\j = T. For all A G 5"^, 1/ e , and p e 5'', 

M/ ^0 ^-iid /ij >T if and only if M >p A U i^, 

(2) Let r e L[K]. Then A G 5"^ - 5^ implies /i e 5"* - 5^ for aU p >^ A. 
Define 

Example 4.1. There are three natural examples that are power-sum friendly. 

(a) We can order set partitions in the refinement order. That is, p > X if i,j in 
the same part of A implies i,j are in the same part of p (here, set partitions 
are equivalence relations on sets) . This relation gives power-sums as defined 
in [12 [9]. 

(b) We can define p > X ii p D X (here, set partitions are sets of arcs), 

(c) We can define p > X ii p ^ X, where >: is defined in Section [5] (here, set 
partitions are sets of arcs). 



Lemma 4.2. // > is power-sum friendly, then 

^(0a)^(r,;y) = -^(Ir.AU^)' A G 5"^, 1/ G , 



IUJ = K 
X=X jUX T 



Proof. Note that 



•5) 



Si>x (5>AUi^ 

where the second to last equality follows from condition (I) of power-sum friendly. 
For the coproduct, condition (2) of power-sum friendly implies the third equality 
in 

^(^(1a)) = E ^^Hm) = E E ^(-^U.w) ® HMj-.t^j) 

/J>A tl>\ K = IU.I 



K = /U J 

ft 

= X! ^{0|/,A,) ^ ^(0|j,Aj)' 

K^/U J 
>.=>.jUA J 

as desired. □ 
The multiplication rule of the P- gives directly the following. 
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Corollary 4.3. sci{U) is freely generated by the P^j, x) "^here (0, A) is atomic. 
4.3. g- Analogues of power sums. For A G 5"^, define 



= E- nst , 



Note that at g = 1 , these functions reduce to the the basis of the previous section 
coming from the power-sum friendly relation C on set partitions. In [7] these 
g- analogues come up naturally in the representation theory of C/„, giving a upper- 
lower triangular decomposition of the supercharacter table of Un . 

Note that the product of these functions is easy to compute, since the nesting 
functions add nicely. Thus, for A e 5"^ and /i G 5"^, 

p{<i) pig) _ pig) 

However, the coproduct is more interesting. We first prove a relevant factorization 
formula. 



en 



-1 



Lemma 4.4. Let cp e L[K], J CK, XeS"^, and G S'^^^' with fi D Aj. Th 

y n (— — 

Z-^ nst" -l-nst-^ , 11 \ nst^ . nst^ - 

Proof. For a fixed u G S^^-^ with ii ^ ^ \j ^ note that 
Thus, 

X! n nst^ n 

(-l)lA'-'-l 
nst" ^-nst"^ , ' 

as desired. □ 

To obtain the antipode below, we want to use Takeuchi's formula p.5p . so we 
compute the restriction rule to arbitrary parabolic subgroups. 

Theorem 4.5. For cf) G L[K], \ e S'*' and J ^ {Ji, . . . , Jg) \= K, 



(9) 



otherwise, 



where 



ai.^ri n 



fe=ii^je^, -A ' ' q '-j 
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Proof. By definition, 



Thus, if A 7^ U A,/^ U • • • U Aj,, then Aj{P^^\-^) = 0. Assume that A = Aj^ U 
A J, U • • • U Aj, . Then we can write 



A 



l<k<t 



By [71 Proposition 3.1], 



«... - V Hl^F^') 



lies* ,tJ.Dv 1 



so 



E ( E nst^ )^( 



By Lemma 14.41 



E « 



as desired. □ 
Remark 4.6. The coefficient ah is not always nonzero. For example if there exists 



Using Takeuchi's formula, we now obtain a formula for the antipode. 



j -^ k £ ^ — X such that nst^^j. — 0, then aj = 
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Corollary 4.7. For cj) e L[K], and A £ S"^, 



D A , 4> - atomic 



where D^{t) is the number of descents of t with respect to 4>. 
Proof. By (^3)) and Theorem 1131 



J^{Jl,J2.,...,Ji) ^ 
J=(Jl,J2,....Jf) 



(0|.7j,M.7f ) 



E ( E 

Tei[Jt],AeST \ .7=(Ji,.72,...,.7£) •'^ 



(9) 



7=(Ji,. 72,.. .,./«) 
M = At Jj^ J2 ..Um.7^ 

^ = *l,7i ■*'l.72 ■ 



Note that — Oj,^ if /.i = /ij^ U /ij2 U • • • U /ij^ = /ijj U /ij^ U • • • U /ij^^ and 
0|ji</'|j2 ■ ■ ■ 01 Jf = ■ ■ •'/'Ij;, ' so 



7=(,7i,J2,...,Jf) 
'' = *l,7i '<'l.72 ■■■*l.7f 



Fix a (/i-compatible fj, € S'^ . Note that r has at least the following two factoriza- 
tions (which could coincide). 

• r — riT2 . . . T; into maximal rising subsequences with respect to (f), 

• T — t[t2 ■ . - t'^ where L is maximal such that each rj is a rising subsequence 
with respect to (p and /i = U • • • U i-i\r'^ ■ 

If C is the set of positions where new factors start in the first factorization and 
F is the set of positions where the new factors start in the second, then every 
factorization of t into rising sequences that respect the arcs of /i have positions P 
with C C PC F. Thus, 



E (-1)^- E (-1) 

J = (.7i,,72,...,.7f) CCPCF 
>'=''JiUmj2U...Umj^ 

T = *l Ji^l J2 ■■■■#'1 



(-1)1^1 J2 ^MP.c). 



CCPCF 

where mb(P, C) is the Mobius function of the subsets of F ordered by inclusion. 
Thus, 

(-l)i ifZ = L, 
otherwise. 



E (-1)^ 



J=(Jl,.72,...,Jf) 
A» = M Jj^ Um J2 U . . .U|J 

'- = *lji*lj2---*lj^ 
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The condition that I = L is equivalent to the condition that (r, /i) is ^-atomic, 
and, in this case, L — I?0(t). Thus, 

fj, 0-atomic 

as desired. □ 
Note 

p(i) _ pC 

is a function corresponding to a power sum friendly relation. The antipode does 
not care which power-sum friendly relation we choose, so we obtain the following 
corollary by setting g = 1 in Corollary 14.71 

Corollary 4.8. For a finite set K,(l)e L[K], A £ S't' , and > a power-sum friendly 
relation, 

X (j)-atomic 

The map K(<p,x) '-^ '^a described in Remark 13.11 defines E /C(scf(/7)) from 
A) ^ scf([/). Recall that k\ and P^ are indexed by sets of arcs A that are in 
Uri>o'^^"- obtain the following direct consequence of Corollary 14.81 

Corollary 4.9. In the Hopf algebra /C(scf ([/)), for n > and A G S^" , we have 



where £(fi) is the number of components in the atomic decomposition of{en,fj) and 
cx.fjL — t^It S L[n\ I A G <S^ is e-atomic, /i — t^^ o A}. 
An equiyalent combinatorial description for the constants ca.^ is as follow. Giyen 

11 j _ w o n — X, w{j) > w{j + 1) if and 

CA,M = # |w G fa„ ^^jy if i ^/c ^' ^ for i < j < j + 1 < /cj 

For example, if 

'=/vO\' 

12345 12345 

then 

CA,,. = #{(1,2,3,5,4), (1,2,4,5,3)1 = 2. 

Define a partial order < on U^eLfif] '^'^ ("^i ^ (''"' •^) 1*^1 ^ I'^l l-^l ^ 1*^1 
with dim(r, v) < dini(0. A). 



Remark 4.10. The formula in Corollary 14. 8l is multiplicity free and cancelation free. 
With respect to < the largest term in the antipode 5'(F(0.a)) is ( — l)'^-P(0fc•••020l,A)■ 
The formula in Corollary 14.91 is cancelation free and is yalid for any power- friendly 
order. In particular, for the examDle l4.1l fa), the formula we get is an improyement 
on the formula of [T3l. 
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5. Antipode on the superclass characteristic functions 

It is interesting to compute the antipode formula for the two other natural basis 
of scf([/). We consider in this section the superclass characteristic functions. 
For A e .S'^ n <S^ with r G L[K], let 



/X T-atomic with /i 3 A, and 
fi Z) v ^ X implies r-dccomposable J ' 



or the set of minimal coarsenings of A to r-atomic set-partitions. 
For example, with 

(0,A) = 

24561378 

The set ^12345678 (0) A) is the Cartesian product of the two sets 
and 



12456 

2456 2456 2456 



^1378 ( ) = { /' \ , / \/ \ , / r\ 

1378 1378 1378 137 



} 



1 3 7 8 1 3 7 

Note that 



\ ^^1378( ), 

• ••• \ • • • • y 



1 3 7 8 1 3 7 

since 



/ /""\ \ 2 / \ 2 

1378 1378 1378 

and {I'-^S} is not 1378-decomposible. 

Theorem 5.1. For a finite set K, t £ L[K], and for any A € S'^ , 



where (j) = (t>i<l>2 ■ ■ ■ 4>k is the unique factorization of 4> into maximal increasing 
subsequences with respect to t, and jj,^^^ is the atomic set partition above . 

Before we prove the theorem, we want to understand the relationship between 
the summands in the theorem and the K-basis. Consider the following poset on S'^. 
Let 

A -<■ /i 
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if /i is obtained from A by adding an arc that connects two atomics of A, where we 
recall that a cover z/ -<• /i is a relation such that the interval [v^^]^ = {i^, /i}. Let 
< be the transitive closure of this relation. For example, for K — [3] and cj) — 123, 




• • • 



Let J — (Ji,...,j£) 1= A', e L[Ji\, and G 5'^' atomic. It follows from 
Proposition [111(2), that 

For example, 

K K — K + K +K 

2456 1378 24561378 24561378 24561378 



n^'r^ nv^r^ 



24561378 



24561378 24561378 24561378 

However, to prove Theorem I5.1[ we need to invert this equation, which is given by 
'^(.<P,i^)= (5.1) 

where mb^(/x, v) is the Mobius function for ^ (computed in Proposition l5.21 below) 
and (0, fi) = ((/)i,/zi) • • • {(j)£, fii) is the unique factorization into atomics. 

The order ^ is almost the same as the <» in Proposition 10 of [91 . The difference 
between the two orders is that some particular covers in the order <* are not present 
in our order ^. Since (0, A) -< {(f), fi) implies A C /i, we may write fi = XU {fi \ X). 

We say (0, A) -< (0, fi) is minimal if for any subset ;B C (^ \ A), the set partition 
BU X ^ fi. For example, when K — [4] and (p ~ 1234, then in the poset we have 




• • • • 



so {1 ^ 4, 2 3} is not minimal over since U {1 — 4} ^ {1 4, 2 — 3}. Note 
that if (0,^) e A^{(t),X), then {(j>,fi) >: (0, A) is minimal. 

The order ^ is a lower-semilattice in the sense that for any {</>, v) and ((/>, /x) 
there is a unique maximal element (</>, v) A (</>, fi) such that (</>, v) A (</>, fi) ^ ((^, v) 
and (^!),z^) A (^,/x) ^ ((/),Ai). 
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Proposition 5.2. For {(p, A) :< {(f>, v) we have that the Mohius function 

{{—\^\^\-\M if {(p^v) minimal, 
otherwise. 
Proof. If ((/), A) < {(f), v) is minimal, then the interval 

[(0, A), v)]^ = {(0, 7) I (0, A) ^ (0, 7) ^ (<^, ^^)} 

is exactly the poset on subsets B Q {v\\). Hence the Mobius function is the one 
given for this case. 

If {(f). A) < {(f), v) is not minimal, then consider the set of elements that v covers, 
C^,x,. = {j\{cf),X)^{(f,,j)^ {(!>,,.)}. 
For example, let ((^, A) — and (</>, — /';\y(y-r '^r^ ■ Then ]y\ X — 



24561378 24561378 



{(1,3), (2, 4), (3, 7), (4, 5)} and 



^ •••••••• 

24561378 24561378 



By inclusion-exclusion, 

mb^((0,A),(0,^.)) mb^((0,A),(0,7)) 

= E (-1)"^' E nib^((0,A),(,/>,p)). 

If we can show that for all sets N 9 that A -< then, as an alternating 

sum of Mobius functions summed over nontrivial intervals, mb^((0. A), {(f>, v)) = 0. 

Since {(p, v) is not minimal, there is% ^ B <Z {v\\) with (0, A) < (0, A U B) ;^ 
{(fi,v). Thus, there exists i'--/ G (i^ \ A) \ S such that i '-^^ does not connect atomics 
in A U Fix such an i^l. 

Either {(j),\VJ{i^l}) < {(t),v) or (</), A U {i — ?}) ^ (0,;^). In the first case, 

(0,AU{*-Z})^ /\ (0,7), 

since B In the latter case, there exists j ^ {v\\)\{i'^l} with i j 
k -<0 L Fix such a j ^k with fc — minimal. Then since A U {{v \ A) \ {j fc}) 7^ 

(0,AU{j-fc})^ /\ (0,7). □ 

Proof of Theorem \5.1\ When K = the result is true by convention. For \K\ > 0, 
it suffices to verify that for all (0, A) the antipode S satisfies the defining relation 

= m{S ® Id)A(K(^,A)) = TO(Id S')A(k(^,a))- (5.2) 
The coproduct on the k basis is 

A(k(0,a)) = E ^(0U,>-f) '^(<#'l./,>j)' 
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Plugging this formula into the right-hand side of (|5.2p with our proposed formula 
for the antipode, we obtain 

E E E (-1)''''"''^'+''*(0U.A.)«(.,..,) • • • Hr.,^,y (5.3) 

To show (I5.3p is zero, we will construct a sign reversing involution among the 
terms. Let if = and let A^p{ip, A/) be the set of minimal elements above {ip, A/) 
in the order ^. By (|5.ip and Proposition 15.21 



where {ip, v) — {^pi, vi) ■ ■ ■ {(pr, Vr) is the unique factorization into (minimal) atom- 
ics. Note that while r = ti • • • in (j5.3p is the unique factorization into maximal 
increasing subsequences with respect to , the decomposition Lp = ipi ■ ■ ■ (pr is a 
factorization into increasing subsequences with respect to <j)\i (without requiring 
maximality). This distinction will produce the sign reversing involution. 
Since |A| = |A/| -I- |Aj|, is equal to 

(— l)l''l + l'>'l ''^'^''K(,pi,-yi) ■ ■ • K(,^^,^^)K(ri,i/i) ■ • • (5.4) 

Define the involution l on the set 



K=iuj, TeL[j],Ae5''''-f^, 



by 

''(^(Vl,7l) ' ' ' ^(Vr,7r)'*(T-l,!'l) ' ' ' '^(rk^'^k)) 

-«(vi,7i) ■ • • '«(<^,.-i,7.-i) («(v.,7.)«(ri,.^i) ■ • • Hrk.i'k)) Otherwise, 
where in each case we think of the r sequence as either gaining or losing a term 
(therefore k increases or decreases). 

This is the desired sign reversing involution that shows that (15. 4p is zero. □ 



Remark 5.3. Note that the formula in Theorem 15.11 is multiplicity free and cance- 
lation free. 

With respect to the poset defined by <] , the formula in Theorem 15.11 is upper- 
triangular. In fact, if {(f), A) = {(f)i, Ai) • ■ • (0^, Afe) is the unique atomic factorization, 
the largest term in S'(k(0,a)) is (-1)''k(0^...020i,a)- 

The image of the formula in Theorem 15.11 under the functor /C is not as pleasing 
as the one we obtained in Corollary 14.81 We leave it to the reader. 

6. Antipode on the supercharacter basis 

In this section, we first show that the antipode has a triangularity property on 
the x-basis, and then provide a formula for the antipode in the special case where 
the underlying set partition has only one arc. However, even this case leads to a 
surprising combinatorial identity. 
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6.1. Triangularity of Antipode on the x basis. Define a partial order on 
V}^&L[K\ ^'^ by (t, ^) <\d (0, A) if dini(T, ^) < dim((/), A). Define constants af \^^^ by 

K=Iu.J ^es'/'l/ 

Note that by Proposition [221 o.'i'^iy ^ implies that dini(0|/, v) + dim(0| < 
dim((/), A) and 

dim(0|/, + dim((/)|,/, = dim((/), A) only if X — ^Uv. 
Proposition 6.1. If X ^ S'^ is atomic, then 

dim(T,/i) <dim(0, A) 

/or some c^''^ £ ^M- 

Proof. We induct on |i4r|. If \K\ = 0, then the result is clear. Suppose \K\ > 0. 
Then by the recursive formula for the antipode 

(/,J)|=if „es*l7 

Since (0, A) is atomic, v U n ^ X for all summands. Thus, if af'^j^ 0, 

dim(0|/, ly) + dim{4i\ j , fi) < dim(0. A). 
Furthermore, since ^i'l>'.f^')^ir'y) ^ ^(0'r\,/ui/') 

dim{(t)'T', fi' U u') ^ dim((?!)', + dim(r', v'), 
the result follows by induction. □ 

Note that since S is an anti-automorphism (see [1]), if (</>, A) — {(pi, Ai) • • • {(pk, Xk) 
is the unique factorization into atomics, then 

Six^'^'^^) = Six^"^''^"^) ■ ■ ■ 5(x('^='^=))5(x'*''^'^)- 

If we combine this observation with Proposition 16. 11 we obtain the following corol- 
lary. 

Corollary 6.2. Let X e S'^ with (0, A) = (0i, Ai) • • • {<pk,Xk) the unique factoriza- 
tion into atomics. Then 

dim(r,/.i) <dim(0,A) 

for some c^-^ G Z[gf]. 

In particular, we obtain that the decomposition of the antipode on the x-basis 
is upper-triangular. In fact, we can choose our basis so that the transition matrix 
is block upper-triangular with signed identity matrices as diagonal blocks. This 
result behaves well with the /C functor. 
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Corollary 6.3. In the Hopf algebra /C(scf(C/)), for n > and A € 5^", let A = 
All • ■ • \Xk be the unique factorization into atomics. We have 

Six') = (-i)'=x''=i-i'^ + E ^AX^ 

dim(/i)<dim{A) 

where dim(/i) = dim(e„,/i). 

This behavior of the antipode on supercharacters was observed at the AIM work- 
shop related to [T] . It is hard to envision a proof of this fact without the Hopf monoid 
techniques. 

6.2. A remarkable factorization formula. Given an integer n, a skew ribbon 
shape r of size n is a sequence of n cells in the plane where any two consecutive 
cells are such that the second cell is immediately east, south or southeast of the 
first. Given a finite set K of size n and a fix r G a standard filling of F is 

an injective map 7 : F ^> A' such that the values of 7 increase (with respect to r) 
in the rows of F (from left to right) and in the columns of F (from bottom to top). 
For example, if K = [9] and t — eg, then 



|l|3 

7 = 



is a standard filling of F 



7 8 



We enumerate the rows of F from top to bottom. For 1 < i < ^(F), if let 
7i = # boxes in ith row of F, 
"f{ri) = set of entries in 7 in the ith row of F, (6.1) 
£(7) = # rows of F. 

In our example above, £(7) — 5, with 71 — 2, j{ri) = {1,3}, 75 = 3 and 7(7-5) — 
{4,7,8}. 

Given (j) G L[K] and a skew ribbon shape F, we say that fits F with respect to 
T if the filling 70 : F — > AT obtained by assigning in increasing order (according to 
0) the values of AT to the cells of F top to bottom, from left to right satisfies 

(i) 7</, is a standard filling with respect to r, 

(ii) If the j + 1st cell of F is strictly southeast of the jth cell, then with respect 
to T the jth element of is less than the j + 1st element of 4>. 

In our running example above with K ~ [9] and r = eg, = (1,3, 5, 6, 2, 9, 4, 7, 8) 
fits the shape F and 7^ = 7. 

Fix a set K and for r e A [A'] let 

Ir = minT-(A'), and TOt — m.ax.r{K), (6-2) 

be the minimum and maximum elements in K with respect to r, respectively. In 
what follows, we are interested in ribbon tableaux 7 = 70 where \r and to,- are in 
distinct rows. We denote by 

fits F with respect to r, and for all 

1 < Z < £(70), |{lr,TOr}n70(r,)| < 1 

Note that in this set we vary the shapes F but always insert the same fillings 70 . 



*r(0) = 70: r->i^ 
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Let (j) = 4>i ■ ■ ■ 4>k be the unique factorization into maximal rising subsequences 
with respect to r and let ti denote the length of We define statistics 

l<i<fc; ti>l 

iOr{4i) = |{1 < * < I = 1 and lr,mr ^ (pi}\ 

rstr(0) = n — 2 — mti-(0) — iOi-(0)- 

For (j) = (1,3,5,6,2,9,4,8,7) and r = eg we have mt(0) = 2, io(7) = 1, and 
rst(7) = 4. 

Theorem 6.4. For any K and & L[K], 

For example, this theorem says that if (/> = 4>\(j)2 = (1, 3, 5, 6)(2, 4) with respect 
to T = eg and K = [6], then 




{t - lft^{t + if = -{2t +l) + {t + if - {2t + l) + {t+ if - {2t +l) + {t + if 




+ {2t + l){t + l)-{t+ if + {2t + If - {2t + l){t + If 




+ {2t + l){t +l)-{t + if - {2t + l){t + if + {t + if. 

This theorem does not really depend on our particular choice of K and r, so it is 
sufficient to get the result for K = [n] and r = e„. We will assume this for the proof 
below. Before proving the general theorem we require a few lemmas. The proof of 
the first lemma was pointed out to us by E. Kruskal. This case addresses the special 
case when = r. In this case, fits any skew ribbon shape F that is not a single 
row and with no two cells in the same column. Moreover, the set {(71, • . • ,7«) | 
7 e ((/))} is exactly the set of integer compositions 7 = (71, . . . , 7^) 1= n such that 
i = ^(7) > 2. 

Lemma 6.5. For n>2 and = r = e„, 

(i-ir-2= Y (-ir-'(72t+i)---(7^-it+i). 

Proof. We induct on n. When n = 2, we have that 1 = (—1)^"^ • 1, as desired. 
Suppose n > 2. Then 

Y (-ir-'(72i+i)---(7^-ii+i) 

= (-ir-2(n-i) + J2 (-ir-'(72i+i)---(7.-it+i). 

j\=n; e{l)>2 
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We separate the second sum into two cases and use induction hypothesis on the 
first one to obtain 

J2 (-ir-'(72t+i)---(7^-it+i) 

7l=n; ((■y)>2 

= (-ir-'(72i+i)---(7^-ii+i)+ Yl (-ir-'(72t+i)---(7^-it+i). 

72 = 1 72 >1 

= (t + i)(t-i)»-3 + Y {-ir-\72t + l)---{je-it + l). 

■y\=n; e{-y)>2 
T2 >1 

For the second sum in this last equahty, wc let 72 = M2 + 1 and ji = fii for i 2. 
Y (-l)"-'(72t + l)-- -(7^-1^ + 1) 

T^n; i{-,)>2 
T2>1 

=E (-ir"'M+i)---(w-ii+i)+t Yl (-ir~'(M3t+i)---(w-ii+i). 

/jNn-l iil=n—l 
e(iJ,)>2 «(m)>2 

Focusing on the first of these two sums and using the induction hypothesis we have 

( E (-ir"'(M2< + l)---(w-ii + l))+(-l)"-'(n-2) 



lj.\=n — l 



Y (-l)"-'-'(M2i + !)•■• (W-ii + 1) = -{t - 1)"-^ 



/»i=»-i 



Substituting all this in the original equation, summing over k = fj,i where /U^ = /ij+i 
and using the induction hypothesis again, we get 

7l=n; f(7)>2 

= (-ir-2 + f(t-i)»-3 + t Y i-lr-\^l3t + l)■■■{^le-lt + l) 

jLtNn-l; £{iJ,)>2 

n— 3 

= + t{t - ir-' + 1 E(-i)' E (-i)""'"'"'(/^2t + 1) • ■ • {^^e-lt + 1) 

fe=l jj'Nri-l-fe 
(:(n')>2 

n— 3 

fe-3 



= + t{t - + 1 E(-i)''(* - 1)" 



= (-l)"-2 + i(f-l)"-3 + (-l)"-2((l_f)"-3_l) = {1-t) 

The following lemma addresses two additional special cases. 

Lemma 6.6. Let K = [n] and r = en 

(1) For^={n,l,2,...,n-l) or <!> = {2, . . . ,n,l), 

{t-ir-h= Y (-1)""'^"^ n 



n-2 



□ 
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(2) for = (n,2,...,n- 1,1), 

Proof. (1) Suppose that (/) = (n, 1, 2, . . . , n — 1) (the case = (2, . . . , n, 1) is similar). 
If 7 G $T-(0), then we have that 7(ri) = {n} and 1 G 7(?'2)- The set $t(</') is in 
bijection with the composition /i 1= n — 1 where fii — 7i+i. In turn, we can add a 
part of size one at the end of /i and obtain 

76*t(0) l,n^7(ri) 

= E (-l)"-'(^'-^(A^2i + l)---(M.(^)t + l) 

/iNn — 1 

= E (-ir"'^"HM2i+i)---(M^(^)-it + i) 

- E (-ir"'*^HM2i+i)---(M^(^)-it + i) 

= E (-ir"'*"HM2i+i)---(M£(M)-i^ + i) 

p^n; e{fj,)>2 

+ E (-l)"-'-''^)(M2t + l)---(A*.(7)-l^+l) 

= (t- l)"-2 + _ l)"-3 ^ (t-l)"-3i. 

where the last line follows from Lemma 16.51 

(2) For 0= (n,2,...,n-l,l),if7 G $r(<?!>), then7(ri) = {n) and7(rf(^)) = {1}. 
Let 0' = (n, 1, 2, . . . , n - 1). The set {7' | 7' G <I't(0'): 72 = 1} is in bijection with 
the set $t(0)- Let 0" = (n — 1, 1, . . . , n — 2) and t" = (1, . . . , n — 1). Removing 1 
and reducing all other entries by 1 for the 7' in {7' | 7' G '^r{4'')i I2 > 1} gives a 
bijection with the set $t-//(0"). We can then use (1) above to get: 

E (-1)"-^^^^ n (7^^+i) 

7e*x(0) l,n^7(ri) 

^ ^ ji (7.'t+i)- E (-ir-'(^'^ n (7.'i+i) 

7'G<I't(0') l,n^7'('"i) y'el/^itt,') l.nfy'(i) 

(i_l)»-3i + J2 (-l)"-i-^(^) n (7.^ + 1) 

(t - + {t ~ lyH = {t-i)''-H^. □ 

Proof of Theorem \6.4\ We factor the expression 

7e'I'T(0) l,n^7(ri) 
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as follow. Let = 4'i(f>2'-'4'k be the unique factorization into maximal rising 
subsequences with respect to r. Define 

((m^,(?!)i,l^),(l^,(/)i,TO^)) lilr.mr ^ 

)^] {i'mr,(f>i),{'t>i,fnr)) ii Ir e (j)i,nir i 4>t, 

(lr,0i)) if nir e (j)i,lT i 4>t, 

if Ir^rrir e (j>i. 



Then 



and the result follow from Lemma 16.51 and Lemma 



□ 



6.3. The antipode for the x-basis. The following argument gives a general for- 
mula for the antipode on x*-'^'^'^"-'. Without loss of generality, we may assume that 
K — [n] and r = e„. Let t = q — 1. By Takeuchi's formula (|3.5p and Proposition 
(1) and (4), 



(,/l,J2,...,Jf)h[»] 

By Proposition E2] (3), 



(-1)^ 



-Res^;(x(^^^-"))---Res^" (x(^'^-")). 



Res^"(x(-'i-")) 



g|[n]\J|^(rL,4-«)^ 



if 1, n, S J, 
if 1 ^ J, 71 e J, 



jeJ\{n} 

^INVIi(/+ ^ x^^l'-'-^^')), ifleJ,n^J, 
jeJ\{i} 

J|i + 1)/ + t ^ ^(-l.^-J)), if 1, „ ^ J. 

By inspection, Coeff (S'(x^'^'""), x'''^'^'') oi^ly if 'f' has a factorization 

(/) = (/)o(ai • V'l ■ bi)(l)i{a2 ■ i>2 ■ b2)(t)2 ■ ■ ■ 0s-i(as ■ i's ■ bs)4's, (6.3) 

satisfying 

(1) n = {tti-'-'bi \ I < i < s,ai ^ bi}, 

(2) the subsequence aitpihi is increasing with respect to r. 

For purposes of counting (this has no effect on whether the coefficient is nonzero), 
let us add the condition 

(3) 1 G {ai, 02, ... , fls} and n e {hi, &2, • ■ • , bs\, where we permit — bi if 
flj G {l,ri}. 

Note that the last condition forces 1 and n to be included in the a's and 6's, but if 
/i does not have an arc with an endpoint at 1 or n, then we are permitted to let it 
disappear by letting = bi. 

For example, if ^ = {2'^5, 7-^8, 13'—- 16}, r — eie, and 



(11, 12, 10, 7, 8, 9, 1, 6, 13, 14, 16, 2, 3, 4, 5, 15), 
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then the factorization for <j) would be 

11 12 10 7^8 9 ? 6 lilAie 2 3 4 5 15 

'f' ^ 00 fll bi 01 0,2 4>2 O^ ■03 &3 "^4 '04 64 04 ' 

O2 

where a2 = 62 = 1 in this case since 1 ^ /Lt for any j. 

We augment by letting 0' = &o0'Js+i where 69 = + 1 a^+i = 0. For 
each < i < s factor the sequence bicjjiai = 0('^^^0('^^' • • • 0(*''») into maximal rising 
sequences with respect to r. Let 



ti<t') 



where 



mti!(0)= ^('/'^'''■^)-2, 

s 

ioi^(0) = ^ #{2 < J < - 1 I £(0(^'^)) = 1}, 



rst^^(0) = ^^(0,) -mti!(0)-ioi!(0). 
Remark 6.7. The notation here is motivated by the fact that 

which we saw in Theorem [631 



Then we have the following theorem. 
Theorem 6.8. For r e L[K], 

(l>eLlK] fj.es'f'ns^ 
where the sum is over all fi such that 

= 0o(ai • V'l • &i)0i(a2 • "02 • &2)02 • • • 0s-i(as • V's • bs)4>s 
factors as in i6.3\) . 

Proof. Let t = q — 1. First, consider for which set compositions J |= [n] 

i-iY 



Coeff - 



-yqie-^Kn-2H-^<. (X*-^""^) • • • Res^; (x^-^^")), x^^-^) ^ 0. (6.4) 

Let Tj = ^IjitI J2 • • • t|jj , and let Tj be the unique skew ribbon shape with row sizes 
given by the block sizes of J such that tj fits Fj with respect to r. Let 7,7 : Fj — >■ if 
be the corresponding ribbon tableau. By Proposition l2.2l (3). condition (|6.4p is true 
if and only if (r, 0, /i, J) satisfy 

(a) (j) — Tj has a factorization (|6.3p with respect to /i, 

(b) there is a sequence 1 < fci < fc2 < • • • < fc^ < ^(77) such that for each 
1 < i < s, we have a^, hi £ lj{rki) (where jj{rki) is as in (|6.1I) ). 
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We say that a quadruple (r, </>, /i, J) satisfying (a) and (b) is compatible. In this 
case, 

= n ((7Ai + l), 

fc^{fel,fe2,...,fcs} 

since 

1^ if 1 -^n G /i. 

Thus, 

Coeff(5(x^'i-"),x(*^'')) = 5] t^-^ n ((7j)fci + l) 

(t.*,H.J) /c^{/Ci,fc2,---,fes} 

compatible 

= i^-i 5] n ((7j);oi + l), (6.5) 

compatible 

since s only depends on /i. 

Next, we write (j6.5p as a product of sums, where each sum will be as in Theorem 
16.41 Note that in (|6.5p the part Jk contributes to the product only when k ^ 
{fci, ^2, . . . , fcs}. Thus, (|6.5I) factors as 

(-i)^t^-i n E (-1)''"^ n (7.^+i)> (6-6) 

0<i<s -r-r^Ki j=2 

t)j0jaj_|_]^ fits r 
f(7)>l 

where i^i is the set of elements in the subsequence bi4>iai+i. 

The inner sums are similar to the sums in Theorem 16. 4[ except that the distin- 
guished elements are the smallest and largest elements of the order bi(j)iai instead 
of t|x;. However, the following algorithm takes an arbitrary ip,T G L[K] and 
constructs new orders (j),T £ L[K] such that 

Step 1: Let = 4>i4'2 ■ ■ ■ (f'r be the maximal decomposition into increasing 
subsequences with respect to r with (f)i — l^cjy'i and (j)r = ^^m^. 

Step 2: Define K — K \ {l^, m^} U {m, Af}, where m and M are elements 
not already in K . 

Step 3: Define 

4>={<t>'^M)(t)2---<t>r-i{m<t>'^). 

Note that we have given (j) in terms of its maximal decomposition into rising subse- 
quences with respect to f, and the lengths of the sequences are the same as those 
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for with respect to r. Thus, 

* fits r fit= r ^ ' \ J ^ 

*(^)>l |{0,M}n7(T-fc)|<l 

by Theorem! 



The theorem now foUows by plugging the z~ ^{t) into (j6.6p . □ 
For example, let r = eie, /J. = {2'~-5, T'-^S}, and 

^0 
11 12 10 7 8 9 1 6 13 14 16 2 3 4 5 15 

— 00 '^1 6l 01 ^2 02 "^3 14 "04 64 04 • 
&2 ^3 

Then 

6o0oai = (17, 11, 12, 10, 7), &i0ia2 = (8, 9, 1), 620202 = (1, 6, 13, 14, 16), 
^^30303 = (16, 2), &404a4 = (5, 15, 0), 

so s = 4, 

mt^(0) =0 + + 3 + + = 3, ioi!(0) = 1 + + + + = 1, and 
rstj!(0) = 3 + 1 + 3 + 0+1-3-1=4 

Thus, 
and 

Coefr(5(x^'^«'''^'^^),X^'^'^^) = i-lft'^it-lft^it+l) 

= {t-lff{t + l). 

A nice consequence is the case where /i = 0, where ;^('^'®) is the trivial character 
of U'l'. 

Corollary 6.9. For a finite set K and (j>,T ^ L[K] 

Coeff(5(x(^'^-'~^'"-)), X^^'®)) = (g - l)zlM - !)■ 
Remark 6.10. Under the functor /C, Corollary 16.91 gives 

Coefr(5(x^-"),X^= E ('?-l)^0.e„(<7-l), 

06L[n] 

and there is no cancelation in this sum. However, if we expand the right hand 
side as a polynomial in < = g — 1 and multiply by (—1)", we discover that all the 
coefficients of t^ are positive for all k. This can be shown using a simple involution 
on the 0's but we do not have a good combinatorial interpretation for the coefficient 
of t^ in that expansion. 
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7. Primitives 

In this section we describe the Lie monoid of primitives of scf(C/). We refer 
the reader to [3] and the references therein for more details on the concepts of Lie 
monoid, primitives and the Cartier-Milnor-Moore theorem for Hopf monoids. In f3] 
there is a description of the primitive space using the Eulerian idempotent, but the 
description is not exphcit. Here, we give an exphcit description using a deformation 
of the Dynkin idempotents. To achieve our goal we construct an explicit basis of 
the Lie monoid. It is best to start from the basis as described in Section S) 

To simplify the notation we will denote this basis with P and suppress a fixed 
power-sum friendly order < from the notation. In the Hopf monoid sc{{U) there 
is a natural Lie monoid structure given by the Lie bracket 

[, ]j j = m/,,7 - mjj o : scf ([/)[/] ® scf (C/)[J] ^ sc{{U)[K] 

where if = / U J and /3/,j : scf ([/)[/] ® scf ([/)[ J] ^ scf ([/)[ J] (g) scf ([/)[/] is given 
by Pi,.j{a®h) = b(S)a. 

For any finite set K, the subspace of primitive 'P{sci{U)[K]) of sci{U)[K] is the 

set 

V{sc{{U)[K]) = {Qe sci{U)[K] I AjjiQ) = 0; (/, J)\=K}. (7.1) 

It is straightforward to check that P{sci{U)[K]) is a sub-Lie monoid (closed under 
the Lie bracket above). 

Since scf([/) is a cocomutative Hopf monoid, the Cartier-Milnor-Moore Theo- 
rem gives us a functor U (analoguous to the universal enveloping algebra for Lie 
algebra) such that 

ZY(P(scf(i7))) = scf (C/). 

In particular, to find a basis for 'P{sci{U)) it is sufficient to find algebraically inde- 
pendent elements in each V{sci{U)[K]) that generates scf(J7). Then, the Cartier- 
Milnor-Moore Theorem gives that P{sci{U)[K]) is the free Lie monoid generated 
by the algebraically independent primitives. A basis of V {scf {U)[K]) is then the 
Lyndon bracket of the algebraically independent primitives. 

Our first step, given any cocomutative Hopf monoid H, is to construct projection 
operators vP: H — > 7^(H). This will be useful to obtain algebraically independent 
primitives. 

For any fc € if, we define 

'^ik,K)= ("l)'~V7oAj, (7.2) 

J = (Jl.....J(,)|=K 
fcSJl 

where mj and Aj are as in (j3.3p and (|3.4p . 

Theorem 7.1. For k £ K, '^(^k,K) '■ H[A'] 7-'(H)[if] is a well-defined projection. 

Proof. To have that 'if(k.K) rnaps into 'P(H)[if], we need to show that A^ ^ o 
^/(^k.K) = for all {A,B) ^ K where A,B ^ 9. For J = ( Ji, J2, . . . , J^) h K, 
several applications of the compatibility condition between A and m, followed by 
coassociativity and cocommutativity show that 



Ayi.B omj o Aj = {{mjnA ° Ajha) (8) [mjnB ° Ajns)) ° ^a,b , 



ANTIPODE AND PRIMITIVE ELEMENTS 



27 



where J D A = ( Ji f) A, . . . , Ji D A) and same for JOB. We thus have 

.7 = (Jl,.-.,J^)|=A- 

fceJi 

We now describe an involution that shows that ah the terms on the right hand 
side canceL Let us first assume that k ^ A. Given J — ( Ji, J2, . . . , Ji) \= K with 
k € Ji, let f3 — min{i : n B ^ 0}. Consider the map 

{(Jl, . . . , J/3-1 U J/3, . . . ,Ji) if J^ n i? = J/3, 

(Ji, . . . , J/3 n A, n B, . . . , J^) if j^ n B 7^ J/3. 

Note that this is a weh defined involution, since if fc e Ji n A, if J/3 n i? = J/3, then 
we must have that /? > 1 and J^_i n A = J^_i. If J/3 n -B ^ J^, then we create two 
non-empty parts J/3 n A and Jfj OB with JpD B still the first part of the resulting 
set composition with non-empty intersection with B. Thus, 

{mjnA o Ajha) ® (mjns o Ajns) = (mc^(j)nA ° A^fjjn^) ® {m^(j)nB ° ^u{j)nB) 

and the terms have opposite signs. The case where fc £ _B is similar, interchanging 
the role of A and B. This shows we get zero and that '^^(^k.K) maps into 7-*(H) [iiT]. 
Since each y — 'i{k,K){x) £ 'P(H.)[K] is primitive, Aj{y) — unless J = (K), so 

J = (Jl J()l=K 

fee Jl 

We conclude that ^(k,K) is a projection. □ 

We can now construct a primitives element Q(0.a) for each (</>, A) atomic. The 
fact that these primitives are algebraically independent and span scf ([/) will follow 
from triangularity relation and Corollarv 14.31 Let 1^ be as in (|6.2p . and 

O(0,A) =^'(l„/f)(-P(0,A))- (7.3) 

This expression can be simplified in our case. Given G L[K] and A G 5"^, 
let A = /ii U /i2 U • • • U /i£ be the maximal decomposition of A into connected 
components. That is, there exists a set partition / — {/i, I2, ■ ■ ■ , le} of K such that 
for each 1 < i < i, 

f^t ^ {fo^ fiJi-- f2, ■ ■ ■ Jd^-i-^fdJ -vvheie <f>\i^ = (j^, j^, . . . , j^J. 

Note that if di — 0, then /i^ = is a single dot. From the definition of the P basis, 
we have that Aj{P(^ij, x)) = unless 

li n Jj ^ implies li fl Jj = !{. 

So Aj{P(^^_x)) 7^ if and only if we can find A — {Ai, . . . ,As) \= [£] such that 
J = (Jai, • . . , JAfc) \= K, where Ja^ = UieA ^i- ^'^^ convenience we may assume 
that l0 G /i, so 

Q(0,A) = E i-^)'-\rn^J.,,...jAj°\j.,,...J.JiPiM)- (7-4) 
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Note that the basis P is such that (to(j^^,j^^,...,j^j o A(j^^ ,j^^,...^j^j)(P(0_a)) is 
a single basis element P{^' ,x) obtained from (</>, A) by reorganizing the components 
HiS according to A. For example, let 

2 4 5 6 1 3 7 

Then, / = ({2, 5, 7}, {4, 6, 1}, {3}) ^ [6] and we have 

/V^ , ((/>|/2,M2) /Y^ , (01/3, Ma) = .■ 

2 5 7 4 6 1 3 

Here, £ = 3 and the set compositions A of {1, 2, 3} with 1 in the first part are 
({123}); ({1,2},{3}); ({1,3},{2}); ({1},{2,3}); ({1}, {2}, {3}); ({1}, {3}, {2}). 
Each gives us a term of Q(x.ct>) as follows 

Q(X4,)^ P - P - P - P 

/7v^. 



2 5 3 7 4 6 1 



2456137 2456173 

+ P + P 

2574613 2573461 

Note that the terms corresponding to ({1}, {2}, {3}) and ({1}, {2, 3}) are the same 
and cancel with each other. This is due to the fact that (0|/2U/3,M2 U /is) is not 
atomic. 

Since the process of regrouping the connected components fii only reduces the 
size of the arcs in /i^, the element P(0',a) = (toj^^,j^^,...,j^^ o^Ja^ ,Ja2,--,^a J(-P(0,a)) 
satisfies dim(0, A) > dim((/i',A) for any A \= [£]. If (</>, A) is atomic and A ^ ([£]), 
then ((/>', A) is not atomic so dim(0, A) > dim(0',A). Thus, when (0, A) is atomic, 
we obtain a triangularity relation 

diin(0',A)>dim(0,A) 

In particular, in this case Q(,f,^\) ^ 0. We have 

Theorem 7.2. The Q(^,x) for (0, A) atomic form a full system of algebraically 
independent primitive elements that span scf{U). 

Proof. For any (0, A), let (0, A) — (0i, Ai) • • • (0,., A^) be its unique factorization 
into atomics. We have that 

dim(0J,Ai)>dim(0i,Ai) 

where in the sum at least one inequality is strict. This shows that scf([/) is freely 
generated by the Q^tjj.x) for (0, A) atomic. □ 

Remark 7.3. Our Theorem l7.2l is closely related to the analogue theorems of Lauve- 
Masnak [T3] and Forest ^llj . The advantage of our expression is that it is multiplic- 
ity free. It is not cancelation free; cancelation occurs when a non-atomic is nested 
under an arc. 

Remark 7.4. Using the functor JC, we recover the formula of [l^ in /C(scf ([/)) from 
(|7.3p . The formula in /C(scf(C/)) will generally have multiplicities but no further 
cancelations. 
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